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WHAT IS CLAIMED IS: 

A system for producing an integrated display audiovisual presentation, 

comprising! 

\ a source of a first audiovisual presentation, wherein the first audiovisual 
5 presentation comprises at least one reference point and at least one reference object, 

wherein at least a ^elected one reference point is associated with a location on a selected 
one reference objectX 

a sourckof user audiovisual information, wherein the user audiovisual 
information comprises am east one replacement point and at least one replacement object 
0 image, wherein at least a selected one replacement point is associated with a location on a 
selected replacement object image, 

correlation mea!fos responsive to the first audiovisual presentation and the 
user audiovisual information, forcorrelating at least one selected reference point with at 
least one selected replacement point, 
5 association means responsive to the correlation means, for associating a 

selected one reference object with a selected one replacement object image, and 

compositing means resporisive to the first audiovisual presentation, the 
user audiovisual information, the association means, and the correlation means, for 
compositing at least one replacement object miage with the first audiovisual presentation, 
:0 producing an integrated display audiovisual presentation, wherein at least a selected 

portion of the replacement object image replaces\a selected portion of the first audiovisual 
presentation. \ 

2. The system as in claim 1, wherein themrst audiovisual presentation further 
\5 comprises a video input signal. \ 



1684 Draft AppLvS (11/27/00) jig 



-50- 



TENT APPLICATION 

Atty Dkt. No. STD 1684 



3. \ The system as in claim 2, wherein the video input signal comprises a time- 
ordered sequence of video images. 

4. The system as in claim 3, wherein the correlation means further comprises 
recognition means responsive to the video input signal, for recognizing at least a selected 
one reference object wijhin at least a selected one video image of the time-ordered 
sequence. 



10 



5. The system asvin claim 4, wherein the recognition means further recognizes 
at least one reference point on the associated reference object. 



6. The system as in cUiim 4, wherein the recognition means comprises at least 
one of pattern recognition means anckimage recognition means. 

1 5 7. The system as in claim 3\wherein the first audiovisual presentation further 

comprises a reference object information identifying and associated with at least a selected 
one reference object. 

8. The system as in claim 7, wherein the reference object information further 
20 comprises identification of at least one selected Reference point on the selected one 

reference object. 

9. The system as in claim 1, wherein the\first audiovisual presentation further 
comprises a time-ordered sequence of video images digitized and encoded into an encoded 

25 digital signal. 

10. , The system as in claim 9, 
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wherein the encoded digital signal comprises a plurality of Motion Picture 



Expert's Group (MPEG) motion vectors, and 

whereirUhe correlation means is further responsive to at least a selected 
one of the plurality of MPEG motion vectors. 



1 1 . The system as in claim 3, wherein the correlation means further comprises 
recognition means responsiveVo the encoded digital signal, for recognizing at least a 
selected one reference object within at least a selected one video image of the time-ordered 
sequence. 



12. The system as in claim 1 1, wherein the recognition means further 
recognizes at least one reference point\on the associated reference object. 



13. The system as in claim 12} wherein the correlation means further 
15 comprises first-order object transformation^means for transforming at least a selected one 
recognized reference point responsive to the selected one of the plurality of MPEG 
motion vectors. 



14. The system as in claim 1, wherein the compositing means further 
20 comprises image transform means for transforming the selected one replacement object 
image associated with the selected one reference object. 



15. The system as in claim 14, wherein tl^e image transform means comprises 
at least one of morphing means, mapping means, stretching means, shrinking means, 
25 rotating means, scaling means, zooming means, curling means, shearing means, and 
distorting means. 
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16. The systeVas in claim 1, wherein the user audiovisual information further 
comprises user object geometric information. 
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The system as in claim 16, wherein: 

the correlating means further comprises recognition means for identifying 
at least a seized one reference object within the first audiovisual presentation, and 

le compositing means further comprises geometric transformation means 
for geometrically transforming the user object geometric information responsive to the 
recognition means. 

18. The system as in claim 16, wherein the compositing means further 
comprises geometric transformation means for geometrically transforming the user object 
geometric information producing transformed user object geometric information, 
responsive to the selected one reference object. 

19, The system as in clairii 16, wherein the replacement object image 
comprises texture map image data representative of at least one selected user object as 
viewed from at least one predefined viewing position relative to the selected user object. 



20 20. The system as in claim 19, wlierein the compositing means selects a 

portion of the texture map image data responsive to the correlation means. 



25 



21 . The system as in claim 20, wherein the compositing means further 
comprises geometric transformation means for geometrically transforming the user object 
geometric information producing transformed user object geometric information, 
responsive to the selected one reference object. 
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The system as in claim 21, wherein the geometric transformation means 
further corrtorises mapping means for mapping the selected portion of the texture map 
image data omo the transformed user object geometric information producing a 
replacement object image. 



10 



23. The system as in claim 3, 

wherein thkuser audiovisual information further comprises a time-ordered 
sequence of user images; and\ 

wherein the association means further selectively associates a plurality of 
the time-ordered sequence of use\images each respectively with selected ones of the time- 
ordered sequence of video images. 



24. The system as in claim K 

wherein the first audiovisua\presentation further comprises a time-ordered 
1 5 sequence of video masks; and 

wherein the correlation means farther comprises selection means for 
selecting a portion of the first audiovisual presentation responsive to at least a selected 
one of the video masks. 

20 25. The system as in claim 24, wherein the selection means is further 

responsive to at least a selected one of the MPEG motion vectors. 



25 



26. A method for producing an integrated display audiovisual presentation, 
comprising the steps: 

providing a first audiovisual presentation, wherein the first audiovisual 
presentation comprises at least one reference point and at least one reference object, 
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wherein at least a selected one reference point is associated with a location on a selected 
one reference object; 

providing user audiovisual information, wherein the user audiovisual 
information comRrises at least one replacement point and at least one replacement object 
5 image, wherein at least a selected one replacement point is associated with a location on a 
selected replacement object image; 

correlating at least one selected reference point with at least one selected 
replacement point responsi\e to the first audiovisual presentation and the user 
audiovisual information; 

10 associating a selected one reference object with a selected one replacement 

object image responsive to the conflation; and 

compositing at least one replacement object image with the first 

audiovisual presentation, responsive tathe first audiovisual presentation, the user 

audiovisual information, the associating, and the correlation, for producing an integrated 
15 display audiovisual presentation, wherein at least a selected portion of the replacement 

object image replaces a selected portion of tnfe first audiovisual presentation. 

27. The method as in claim 26, wherein the correlation further comprises the 
method of recognizing at least a selected one reference object within an image of the first 

20 audiovisual presentation. 

28. The method as in claim 27, wherein the recognizing further comprises the 
method of recognizing at least one reference point on the associated reference object. 

25 29. The method as in claim 27, wherein the recognjzing further comprises at 

least one of the methods of pattern recognition and image recognition. 
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30. \ The method as in claim 28, wherein the first audiovisual presentation 
comprises encoded digital signal comprising a plurality of Motion Picture Expert's Group 
(MPEG) motion vectors, and wherein the correlation further comprises the method of 
transforming at leasia selected one recognized reference point responsive to a selected 
5 one of the plurality ofvMPEG motion vectors. 




3 1 . The method\as in claim 26, 



isas 

wherein the compositing further comprises the method of transforming the 
selected one replacement object image associated with the selected one reference object; 
10 wherein the transforming is at least one of the methods of morphing, 

mapping, stretching, shrinking, rotating, scaling, zooming, curling, shearing, and distorting. 



32. The method as in claimv26, 

wherein the user audiovisual information further comprises user object 
1 5 geometric information; \ 

wherein the correlating further comprises the method of recognizing at 
least a selected one reference object within tl^e first audiovisual presentation; and 

wherein the compositing further* comprises the method of transforming the 
user object geometric information responsive to the recognizing, producing transformed 
20 user object geometric information. 

33. The method as in claim 32, 
wherein the replacement object image comprises texture map image data 

representative of at least one selected user object as viewed from at least one predefined 
25 viewing position relative to the selected user object; and \ 

wherein the compositing further comprises the method of selecting a 
portion of the texture map image data responsive to the correlation. 
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34\^ The method as in claim 33, wherein the compositing further comprises the 
method of mapping the selected portion of the texture map image data onto the 
transformed user\pbject geometric information, producing a replacement object image. 



5 35. The method as in claim 26, 

wherein the first audiovisual presentation further comprises a time-ordered 
sequence of video images; 

wherein the user audiovisual information further comprises a time-ordered 
sequence of user images; and \ 
10 wherein the association further comprises the method of selectively 

associating a plurality of the time-orcl^red sequence of user images each respectively with 
selected ones of the time-ordered sequence of video images. 



36. The method as in claim 30, wherein the first audiovisual presentation 
15 further comprises a time-ordered sequence of Video masks; and 

wherein the correlation further comprises the method of selecting a portion 
of the first audiovisual presentation responsive t\^t least a selected one of the video 
masks and at least a selected one of the MPEG motion vectors. 



20 37. A system for providing an integrated display audiovisual presentation, 

said system comprising: ^ 

a first audiovisual presentation comprising a selected portion and having at 
least one reference point associated with a location on a selected one reference object and 
at least one reference object having at least a selected portion of a selected replacement 
25 object image associated with at least a selected one replacementpoint; 

wherein the selected one reference object is replaced with a selected one 
replacement object image responsive to an association determined responsive to a 
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correlation of at least one selected reference point with at least one selected replacement 
point. 




The presentation system as in claim 37, wherein the correlation is 
responsive to recognizing at least a selected one reference object within the first 
audiovisual presentation. 



39. The presentation system as in claim 38, wherein the recognizing is at least 
one of pattern recognition and image recognition. 



40. The presentation system as in claim 37, wherein the first audiovisual 



jfti presentation comprises encoded digital signal comprising a plurality of Motion Picture 



Expert's Group (MPEG) motion vectors, and wherein the correlation is further 
responsive to a selected one of the plurality of MPEG motion vectors. 



4 1 . The presentation system as in claim 37, wherein the selected one 
Si repiacemen, object image is transformed by^t one of morphing, mapping, stretching, 

shrinking, rotating, scaling, zooming, curling, shearing, and distorting prior to the 



replacing. 



42. The system as in claim 37, wherein the replacement object further 
comprises user object geometric information that is transformed, producing transformed 
user object geometric information, responsive to the recognition of at least one selected 
reference object within the first audiovisual presentation, prior to the replacing. 



43. The system as in claim 37, 
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wherein the replacement object image is a selected portion of a texture map 
image; and \^ 

wherein&e texture map image data is representative of at least one 
selected user object as viewed from at least one predefined viewing position relative to the 
selected user object. 

44. The system as in^claim 43, wherein the selected portion of the texture map 
is r 

replacing. 



inycl 

image is mapped onto transformed user object geometric information, prior to the 



45. The system as in claim 37, 

wherein the first audiovisual presentation further comprises a time-ordered 
sequence of video images, and 

wherein the association further selectively associates a plurality of 
15 replacement object images each respectively \^ith selected ones of the time-ordered 
sequence of video images prior to the replacing^ 

4&v A system for processing a video input signal having an associated original 
video image, me^system comprising: 
/ 1 ' 20 addressable storage providing wireframe memory, a texture map memory, a 

iyS processor instruction memfcnr, and a secondary image memory; 

means for generating oy^ntation signals responsive to the video input 

signal; 

means for generating & vW^&frame geometry signal responsive to the 
25 orientation signals and to the wireframe memory; 

an encoder, responsive to the videoT^put signal, for generating encoder 

signals; 



1684 Draft AppLvS (11/27/00) jig 



-59- 



TENT APPLICATION 

Atty Diet. No. STD 1684 



10 



means for selecting respective ones of the encoder signals as a masked area 
of selected encoaer signals responsive to the encoder signals and the orientation signals; 

wireframe compositing apparatus responsive to the selected encoder 
signals and the wireframe signals to generate a composited wireframe signal; 

texture map compositing apparatus responsive to the composited 
wireframe signal and to the texture map memory for generating a composited wireframe 
and texture map signal; and) 

a blender responsive to the video input signal and the composited 
wireframe and texture map signal for generating a final composited video signal comprising 
the image with proper orientation mapped as a part of the original video image onto the 
identified predefined video object for which the orientation has been determined. 



47. The system as in claim 46, wherein the wireframe memory provides for 
output of the wireframe signal by look-up in a stored data table of wireframe data signals 

1 5 indexed by orientation. 

48. The system as in claim 47, wnjerein the wireframe signal is extrapolated 
utilizing two defined orientations. 



20 49. The system as in claim 48, wherelp the wireframe data signal is generated 

responsive to stored orientation data. 



25 



50. The system as in claim 46, wherein t^e motion vector encoder is an MPEG 
encoder. 

51. The system as in claim 46, wherein the Wireframe compositing apparatus is 
responsive in accordance with predefined processing logt| 



30 



52. The system as in claim 46, wherein the encoder is a motion vector encoder 
the encoder signals are motion vector signals. 
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53. The system as in claim 52, wherein a processor generates motion vectors 
responsive to the processor instruction memory, the buffered original video input signal, and 
responsive to predefined lhstruction logic. 



10 



54. The system as irKclaim 
cues within the video input signal 
tracking and substitution. 



55. 



46, wherein the system is responsive to expression 
lecting a portion of the original video image for 



The system as in claim 46^wherein the original video image is further 
comprised of a target image for detection by the system for use in tracking. 




\ 
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